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(57) Abstract 

During electronic film development, 
an area of conventional photographic film is 
scanned several times using a single scan- 
ning station, and at each subsequent time 
this scanned area is advanced incrementally 
along the film with multiple levels of over- 
lap with previous scans. The new image 
scanned at each new time is aligned to an 
accumulating image that has been extrapo- 
lated to the image at the new time, and then 
the new image is added to the accumulating 
image in parametric summations that allow 
an image to be interpolated to any time free 
of seams where the scans overlap. The in- 
vention further teaches a method of steering 
the alignment by warping the leading edge 
of the alignment, and a registration method 
of aligning multiple images that takes ad- 
vantage of known fixed alignments between 
images. 
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PROGRESSIVE AREA SCAN IN ELECTRONIC FILM DEVELOPMENT 



BACKGROUND 

Electronic film development is a process in which conventional silver halide film is 
5 electronically scanned during the actual development process, rather than waiting, as in the 
common art, until development is finished. Electronic film development is taught in U.S. Patent 
No. 5,519,510 issued to the present inventor. 

With electronic film development it is possible to build a history of the emerging image 
through different phases of development. Early in development, highlights reveal the greatest 

10 clarity. Conventional development would proceed past this point into total darkness, but by 
capturing the image at this time, highlight details that would normally be lost are saved. 
Conversely, conventional development would end development at the optimum compromise point. 
But by developing past that time and continuing to capture the image during continued 
development, image details that would normally be lost can be coaxed from the shadows. 

15 Thus, one key to electronic film development is the ability to capture images-of the same 

piece of film at different development times and to later merge these images into one image with 
more detail than in conventional development. This merging is called "stitching". In the prior art, 
stitching was performed by effectively cutting out and aligning parts of the different development 
time images, and pasting those image fragments back together. 

20 This system is capable of coping with variations or jumps in sample times that would confuse 

the prior art method of stitching. For example, if all the samples were made 30 seconds later, but 
all the densities were proportionately higher, the same continuous curve would of course be 
described without special corrections required to make individually captured image densities 
coalign. 

25 Additional background art is described in U.S. Patent No. 5,465,155 developed by Al Edgar. 

This known process extends electronic film development to tricolor image capture. In duplex film 
scanning, a conventional multilayer color film is scanned during development in three ways: by 
reflected light from the back, by reflected light from the front, and by transmitted light from either 
the front or back. Each of these three ways of scanning "sees," to varying degrees, the front, 

30 middle, and back layers of the multilayer film. By mathematically differencing the images seen 



□mcrwin /Wn 



PCT/US99/03846 

WO 99/43149 

-2- 

in these three ways, all colors can be distinguished and, through color mapping techniques, can be 
assigned to the correct colors. 

Figure 1 presents a basic apparatus for electronic film development. A filmstrip 102 is placed 
under development by immersing the entire film in a transparent developing tank (not shown for 
clarity). During development, an infrared lamp 104 is switched on to illuminate a developing 
image 106 on the film. Light passing through the film 102 containing the image 106 is focused 
by lens 108 onto an area sensor array 1 10. At the same time, light reflected from the front of the 
film 102 containing the image 106 is focused by lens 1 12 onto an area sensor array 1 14. After the 
back transmission and front reflection images have been received by the sensor arrays 1 10 and 1 14 
and stored in a computer memory, the lamp 104 is extinguished and the infrared lamp 120 is 
activated. With lamp 120 on, the sensor array 1 14 receives a front transmission image, and the 
sensor array 110 receives a back reflection image of the light from the film 102 containing the 
image 106. In the course of electronic film development, this process is repeated any number of 
times to receive multiple images made during development. 

The problem with the apparatus of Figure 1 is that only one frame can be developed at a time. 
The method also requires very precise placement of developer application to transition in the thin 
space between frames. Further, the method requires precise alignment of frames on a film before 
development is started. If a mistake is made in frame alignment, which is easy to do before any 
image has begun to develop, a seam will appear within a frame, ruining the image exposed in that 
frame. This hit or miss development is unacceptable for general use. 

Figure 2 presents a prior art refinement of an electronic film development apparatus. In 
Figure 2, a filmstrip 202 is moved continuously to the right without requiring foreknowledge of 
frame boundaries. Developer is applied at station 204. At some time after application of 
developer, the film 202 will be positioned under line 206. At this line 206 the film 202 is scanned 
by two linear scan arrays: a front array 210 receives light imaged through lens 212, and a back 
array 214 receives light imaged through lens 216. In conjunction with front lamp 220 and back 
lamp 222, the front refection, back reflection, and transmission images can be received as 
described in Figure 1 . 

In the apparatus of Figure 2, sensor arrays 210 and 214 will always receive images of the film 
202 at a specific development time fixed by the time of transport between the developer 
application station 204 and the line being scanned 206. A second scanning station viewing line 
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230, and a third scanning station viewing line 240 capture two additional images at two additional 
distinct times. Combined, the three scanning stations provide three views of the image in the film 
at three points in time. 

Because of the ability to continuously move the film 202, the apparatus of Figure 2 solved the 
5 problem of knowing frame boundaries before development. In fact, the entire film is developed 
seamlessly, with the assumption that further software can parse the continuous film image into 
separate frames. 

The prior art apparatus of Figure 2 has some serious disadvantages that severely limited the 
commercialization of electronic film development. The three scanning stations of Figure 2 would 
1 0 cost on the order of three times that of the one scanning station of Figure 1 . Further, as explained 
above, an improved image would be obtained by scanning the image many more times than three. 
Although the apparatus of Figure 2 could contemplate additional scanning stations, the cost would 
grow proportionately. Further, the line scanners of Figure 2 require much more light than the area 
scanner of Figure 1. 

15 Another serious flaw in the apparatus of Figure 2 is the problem in later aligning the images 

made at the different scanning stations. The image made along line 230 is scanned at a different 
development time from the image made along line 206, and therefore contains different image 
details. Because of the differences in these images, registration of these images in software was 
difficult and often done improperly since prior art software had difficulties aligning images with 

20 different sets of details. In response to the inability of software to align the images, the apparatus 
of Figure 2 relied on expensive, precision mechanics for alignment, further increasing the cost. 
Electronic film development promised a universal film that could be used in conventional cameras 
and yet give unprecedented image detail as well as give a widened sensitivity range that would 
embrace the natural light of life without reliance on harsh electronic flash. The further promise 

25 of electronic film development was for a small development apparatus, with no plumbing, that 
could fit beside a desktop computer in businesses, schools, and homes to accelerate the image 
literacy revolution. The problems described above seriously compromised these dreams by 
making an electronic film development apparatus too expensive for families and schools to afford. 
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OBJECTS OF THE INVENTION 

A primary object of this invention is to provide a simplified method of electronic film 
development. 

A corollary object is to perform seamless scanning during film development with a single area 
5 scan station. 

Another corollary object is to perform an arbitrary number of scans per film area with 
seamless coverage. 

A further object is to perform seamless scanning at multiple times during development with 

a single linear array scanner. 
10 Another object is to provide improved registration accuracy of the various scans made during 

the course of electronic film development. 

A further object is to provide a nondiverging registration in electronic film development. 

Another object is to reduce computational time in registering the various scans made during the 

course of electronic film development. 
1 5 SUMMARY OF THE INVENTION 

These and other objects are accomplished in accordance with the teachings of this invention 

by scanning film in sequential areas that have multiple levels of overlap. The areas can be scanned 

by an area array or by a linear array rapidly moving so as to scan an area. The single scan area is 

iteratively moved with many levels of overlap to reduce the number of stations required by the 
20 prior art, thereby simplifying and lowering cost. The overlapping areas, in conjunction with other 

features of the present invention, prevent the seams created by the prior art method that used a 

single scanning station. 

The scanned areas are accumulated in a film array representing the film. Each new area 

scanned is registered with the image already laid in the film array. This is made possible because 
25 the multiple levels of overlap insure that most of each new scan covers a part of the film previously 

scanned. In addition, the leading edge ahead of previous scans defines a region in which the 

registered new image can be warped to steer the growing image and prevent it from diverging out 

of the film array. 

Registration is performed by first estimating, from previous scans, how the film looks at the 
30 time of a new scan, and then registering this new scan to this extrapolated estimate for increased 
accuracy. Once registered, the density from the new scan is accumulated in the film array as a set 
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of parameter summations for later parametric regression of the density versus time curve for each 
pixel. Accumulation is weighted in a sparse fashion across the elements of the film array. 

Front reflection, front transmission, back reflection, and back transmission scans are made at 
each time. The front and back transmissions are registered to each other, then the merged result 
5 is accumulated in a single transmission film array. The front and back reflection scans are 
assumed to be in perfect register with the front and back transmission scans, respectively, and 
therefore the registration data for the transmission scans also applies to the respective reflection 
scans, saving computation time. 



1 0 DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates the prior art of electronic film development. 
Figure 2 illustrates an improved prior art method of electronic film development. 
Figure 3 presents a preferred embodiment of the present invention. 
Figure 4 details the use of a position array in sparse mapping. 
15 Figure 5 shows a progression of scans across two points. 

Figure 6 shows parametric regression with the points in Figure 5. 

Figure 7 portrays the improved registration method of the present invention. 

Figure 8 illustrates registration drift and steering. 

Figure 9 is an overall view of the present invention illustrating coregistrations. 

20 

ENABLING DESCRIPTION OF THE INVENTION 

The basis of the present invention is now described with reference to Figure 3. This basic 
description will leave issues of registration and overlap banding to be handled in reference to later 
illustrations. In fact part of the reason the basic description in Figure 3 was not obvious in the 

25 prior art was that there was not a known solution for these associated problems. 

In Figure 3 a filmstrip 302 advances to the right. An area of the film 302, such as area 304 
representing the capture area at time Tl , is imaged by lens 306 onto area sensor 308. As the film 
302 advances to the right, the sensor 308 will be sequentially exposed to capture areas labeled T2, 
T3, and T4. The image impinging on area sensor 308 is digitized into discrete pixels and stored 

30 in cyberspace as elements of an array 3 1 0. A position array 3 1 2 matches to each pixel in array 3 1 0 
an (x,y) position pair pointing to a spot in film array 314. The positioning pair may have fractional 
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values and may point between actual pixels, or array elements, in the film array 314. Film array 
314 seeks to match the original film 302, shown mirrored as virtual film 316, such that each point, 
such as point 3 1 8 in the virtual film 3 1 6, has a fixed point 320 in the film array 3 1 4 that remains 
fixed relative to the film 302 as the film 302 moves. 

5 Any specific point in the film array 3 1 4, such as point 330, may be pointed to by any element 

in the position array 312. For example, at a first time Tl, element 332 in the position array 312 
points to point 330, thereby carrying element 334 in the sensor array 310 to point 330 in the film 
array 314. Sensor array element 334 is seen to map through sensor element 336 onto the film 302 
at point 338. Similarly, points 340, 342, and 344 in the film array 314 map respectively to points 

10 346, 348, and 350 on the actual film 302, such that block 304 in the film 302 maps to block 352 
in the film array 3 1 4. For example, point 350 on the film 302 is seen by sensor element 354 in the 
sensor 308, has its density stored in element 356 of the sensor array 3 10, and is mapped by element 
358 of the position array 312 to point 344 of the film array 314. 

Point 344 in the film array 314 can be pointed to by any element in the position array 312. 

15 For example, at a second time T2, element 360 in the position array 312 holds the same (x,y) 
position numbers as element 358 did at time Tl . Therefore, mapping through the sensor array 3 10, 
sensor element 364 of the sensor 308 will map to the same point 344 in the film array 314 as 
sensor element 354 did at time Tl . Note that as the film 302 advances to the right, element 364 
of the sensor 308 will view the same point 350 on the film 302 as did sensor element 354 at the 

20 first time Tl . Similarly, as the film 302 continues to move right, point 350 on the film 302 will 
be focused by lens 306 on, sequentially, sensor elements 354, 364, 366, and 336 of the sensor 308. 
Therefore, in the position array 312, the same numerical (x,y) position numbers will appear 
sequentially at elements 358, 360, 368, and 332, to carry the same point 350 on the film 302 to the 
same point 344 in the film array 314 despite movement of the film 302 and subsequent change in 

25 the position on the sensor 308 at which the point 350 is measured. 

The basic principle of the invention is to sense a region of the image at each frame of time m 
order to provide the advantages of the prior art apparatus of Figure 1 ; namely, the ability to make 
many samples of each point on the film as a function of time with only a single scanning station. 
Furthermore, the invention combines incremental movement with each scan to also provide the 

30 advantages of the prior art apparatus of Figure 2; namely, the elimination from major seams 
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between individually developed frames, and the corresponding need to guess frame boundaries 
before any image is visible. 

The area as described can be scanned with an area array 308 as illustrated in Figure 3. An 
area array typically consists of a two-dimensional array of sensors. However, as is well known, 
5 an area can also be scanned by a linear array that is moved rapidly in a cross scan direction 
perpendicular to the one-dimensional line in which the individual sensors are arranged. The time 
it takes to perform this cross scan must of course be less than the time difference between the times 
individual areas are scanned at times Tl to T4. If the scan time approaches this time, then the 
areas diverge from rectangles and become parallelograms. This distortion can, however, be 

1 0 removed by correcting the position array 3 12 so as to map the sensor array 3 1 0 to the film array 
314 such that the mapping to the virtual film 316 reflects the actual parallelogram area scanned 
on the real film 302. This correction process is described in more detail below. 

The additional components needed to make the invention even more practical are a method 
of registration that will succeed where the prior art using the apparatus of Figure 2 failed, and a 

15 method of avoiding faint seams between each minor advance of the sensing area. These 
components will be disclosed with reference to later illustrations. 

Figure 4 explains in more detail how the position array maps specific elements in the sensor 
array into the film array. In the specific numerical example of Figure 4, element (18,27), also 
called element 402, of the sensor array 404 contains the measured density value 80. Element 

20 (1 8,27), also called element 406 of the position array 408, maps this density data of 80 to location 
(39.0,23.5) in the film array 410. When so mapped, element 402 of the sensor array 404 
materializes in the film array 410 at position 412, which is seen to be midway between discrete 
elements (39,23) and (39,24). 

A problem now arises as to how the density data is to be copied into the film array. A simple 

25 resize, commonly used in the art, will give suboptimal results. As a preferred embodiment of this 
invention, a "sparse resize" is done, as is now defined. In a sparse resize, a mapped element block 
the size of a pixel block in the film array 410 is conceptually drawn around each mapped element, 
such as element 412, and the data of that element added to each pixel in the film array 410 in 
proportion to the degree of overlap of that pixel's block with the mapped element block. In the 

30 specific case of element 412, half the data would go to film array element (39,23), and half to 
element (39,24). In the specific case of element 414, seen from element (17,27) of the position 
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airay 408 to map to position (37.5,23.7) in the film array 410, 1 5% weighting would go to element 
(37,23), 15% to element (38,23), 35% to element (37,24), and 35% to element (38,24), each in 
proportion to the overlap of block 418 with the respective pixel of the film array 410. 

The nomenclature "sparse resize" emphasizes that the weighting is not uniform. Suppose that 
the mapping was very sparse such that many pixels of the film array 410 were skipped between 
mapped pixels from the sensor array 404. In this case, there could be elements of the film array 
410 that were not advanced at all with any individual scan. It is then hoped that other scans, 
whether by randomness or purposeful interlace, will fill in those empty data points in the film 
array. To the extent all the points get filled through multiple scans, the advantages of a dithered, 
or interlaced, sparse sensor array are realized; namely, vernier resolution is increased beyond the 
actual pixel spacing limits of the sensor array. 

Even where there are insufficient scans, or where randomness or purposeful interlacing have 
failed to adequately fill all the elements in the film array, the deficient elements of the film array 
can average data from adjacent elements with no worse resolution loss than if the sensor array had 
been mapped to the film array through a conventional resize. 

Further, in order to later practice a technique called parametric stitching, the data accumulated 
in each element, or pixel, of the film array should be derived parameters from the sensor array 
data. For example, each element of the film array may consist of four parameters. The first 
parameter might be a running summation of the total weighting of all elements from the sensor 
array applied to that pixel, the second may be a running summation of that total weight times the 
density from the sensor array pixel, the third may be a running summation of that weight times the 
density times the time the density was measured, and the fourth may be the running summation 
of that weight times the density times that time squared. 

A method for registration of the images will now be discussed, and in particular a solution to 
registering images made at different development times will be presented. The solution is enabled 
by a technique called parametric stitching, which will now be discussed with reference to Figures 5 
and 6. 

In Figure 5, a piece of film 502 moves continuously to the right under developer application 
module 504. Several time scales will be used in describing this process. Absolute time can be 
used to specify the time a scan is made. For example, area 506 was scanned at time Tl, area 508 
was scanned at time T2, and area 510 was scanned at time T3. Another time scale is the time of 
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development. Because developer is applied at station 504 and the film moves at a constant speed 
to the right, the development time is proportional to the distance between the developer application 
station and any arbitrary point at the moment that point is scanned. For example, the entire area 
510 is scanned at time T3, but two points in the region, point 520 and point 522, will each have 
5 received a different development time at the instant of scan. Point 520 will be referred to as the 
dot point, and point 522 as the x point. 

The problem at hand is that area 512, shown by dotted lines, is just being scanned at time T4, 
and it will be necessary to spatially register this new scan with the previous scans. As explained 
in the background section, the special problem is that, because this scan occurs at a later time than 

1 0 any of the other scans, it does not match any earlier scan, making registration difficult. 

Figure 6 shows a curve 602 representing density versus development time for film exposed 
to a constant light. Assume the x point 522 received this exposure. At time T4 the new, as yet 
unregistered, scan will see the x point at time-density 606. The problem is to extrapolate, from 
existing scans, a scan that does in fact match this density so as to facilitate registration. The x 

1 5 point is measured at time Tl to be at time-density point 610, at time T2 to be at time-density point 
612, and at time T3 to be at time density point 614. 

Note that all the x points lie on the common density curve 602. This curve 602 can be 
described parametrically as, for example, A+Bt+Ct 2 . A best fit curve 602 is found through all the 
x points, and extrapolated to density 606 at the development time at which the x point is scanned, 

20 here at time T4. Thus at the x point the image scanned at time T4 can be given a registration target 
that is a good estimate of the actual image, and registration is thereby facilitated. 

Also note that all the dot points lie on another common density curve 620 defining the 
exposure of the dot point 520. The dot point 520 is outside the scanned area at time Tl, but is 
inside a scanned area at time-density point 622 at time T2 and at time-density point 624 at time 

25 T3. From these points, regression mathematics give an estimation 626 for the density of the dot 
point at the development time scanned at time T4, giving the image at T4 a matching target with 
which to register. 

Figure 7 summarizes the registration process at a higher level. A pixel 702 in transmission 
sensor array 704 is surrounded by a small region 706. Pixel 702 is mapped by the (x,y) coordinate 
30 at coincident location 708 in the position array 7 10 to point 7 1 2 in the transmission film array 714. 
At a later time, another scan is made, and it is necessary to register this new scan to the data 
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already in the transmission film array 714. Only after the new scan is properly registered can it 
be added to the accumulating data in the transmission film array 714. If it were to be added out 
of register, the resultant image would appear smeared. 

In order to accomplish registration, several steps are necessary. First, an estimate is made, 
5 based on dead reckoning using film speed and time between scans, that the new mapping will 
place pixel 702 at point 720 in the transmission film array. To practice dead reckoning, the film 
velocity is multiplied by the time between scans, and the resulting displacement vector added to 
the previous scan area to estimate where the new scan area will locate. To test the accuracy of this 
estimate, and to correct any errors, the parameters at point 720 are extrapolated to estimate the 

10 density at the time of the new scan. The parameters of all points around point 720 are similarly 
extrapolated to produce predicted point 722 and the predicted region around point 722. Now the 
image and region around it projected from point 702 through position array 710 is registered with 
the predicted point 722 and the region around it. A registration process known in the art finds the 
cross correlation between the two images at a number of small incremental offsets. The offset 

1 5 giving the highest cross correlation is the best estimate of the optimal registration position. For 
example, it may be found that point 702 should actually map to point 726, rather than point 722, 
because, for example, the mechanical transport was slightly misaligned. As the final step in this 
process, the data at pixel 702 is added to the transmission film array at point 728. 

Figure 8 points to a problem which occurs when simply registering new scans to existing 

20 scans, and presents a solution. The problem is similar to the steering problem in a car in which 
an assumption is made that if the car starts out aimed in the right direction, and the steering is 
correctly aligned, that no steering is needed to reach a destination. The solution adds a steering 
feedback to the registration process. 

In Figure 8a, an area 802 of a film 804 is scanned. Due to optical and mechanical 

25 misalignments, the scan is not square, and therefore imaginary square gridlines 806 in the image 
will be written to the film array 810 skewed as shown if the image array outline itself is written 
to the film array initially as a perfect rectangle 812. 

The next scan may cover region 830 on the film. When this is registered to the emerging 
image 812 in the film array 810, it will begin to diverge, like an automobile with misaligned 

30 steering. The effect after several iterations is seen in Figure 8b to be a divergence in position on 
the film and in magnification. In Figure 8b, the first scan was laid into the film array at block 840. 
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The next was overlaid in register at block 842, the next overlaid block 842 at block 844, and the 
next overlaid block 844 at diverging block 846, each building on and compounding the 
misalignment of the previous. Although the misalignment illustrated in Figure 8 may be 
considered extreme, it is apparent that even good alignment can rarely pass an entire film without 
5 running off the edge of the film array. 

The steering needed to maintain alignment is illustrated in Figure 8c. A block from a 
particular scan is shown as block 850. A next block containing a subsequent scan could be placed 
at location 852 if the image is registered, but, as seen above, this will lead to widening divergence. 
Alternatively, the next block could be positioned at location 854 based on dead reckoning. The 

10 dead reckoning positioning will never diverge or change magnification; however, to the extent the 
image is misaligned, it will overlay multiple images out of register, blurring the images. 
A solution is discovered by noting that there is a region around point 860 for which the new scan 
sees the film for the first time, and there is no previous image. In this region the registration based 
on extrapolation of the best fit can be warped in any way without affecting blurring. Subsequent 

15 images will then track the new warp. There is also a region around point 862 for which only a 
weak previous image existed, and any warpage from the best fit will result in only a small blurring 
in this region. Finally, there is a region around point 864 for which the image has been well 
established with multiple previous scans, and no warpage is tolerable. Note that the most serious 
divergence occurs at the leading edge in the region around point 860, for which any correcting 

20 warpage is tolerable. 

Therefore, the solution is to select a block 866 between the best fit registered block 852 and 
the dead reckoned block 854. In particular, in the region around point 860, the bias will be toward 
the dead reckoning block, blending smoothly to be near the registered block in the region around 
point 862, and finally blending to exactly align to the registered block 852 in the region around 

25 point 864. For example, point 870 at the leading edge is biased farthest from the best fit registered 
point 872 toward the dead reckoned point 874, while point 876 at the transition region is biased 
strongly toward the best fit registered point 878 away from the dead reckoned point 880, and point 
882 lies directly on the registered point. This method is seen to provide a steering feedback at the 
leading edge that guides the leading edge back to nominal magnification and position. Further 

30 improvements can include integral feedback and damping techniques known in the art of feedback. 
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Finally an overall electronic film process will be described with reference to the present 
invention using Figure 9. The relationships between registrations of the front reflection scan, back 
reflection scan, and two transmission scans will be described. 

In Figure 9, a filmstrip 902 under development moves to the right. A front lamp 904, front 
lens 906 and front sensor 908, in conjunction with a back lamp 910, back lens 912, and back 
sensor 914 (at the bottom of the figure), in concert receive the front reflection, front transmission, 
back reflection, and back transmission scans in the manner described previously with reference 
to Figure 1 . 

The front reflection scan made with the front sensor 908 and front lamp 904 is placed in the 
front reflection sensor array 920. At the same time, the light from lamp 904 used to illuminate the 
front reflection scan can be used in conjunction with the back sensor 914 to illuminate the back 
transmission scan and that scan placed in the back transmission sensor array 922. Within a time 
so short the mechanical movement of the film is much less than a pixel, the front lamp 904 is 
extinguished and the back lamp 910 is activated to illuminate the front transmission scan and back 
reflection scan, receive these scans through sensors 908 and 914 respectively, and place these 
scans in respectively the front transmission sensor array 924 and the back reflection sensor array 
926. 

Next, the front transmission sensor array 924 will be registered to the transmission film array 
930 through the front position sensor array 932, and the image added to the transmission film array 
930, using the technique previously disclosed with reference to Figure 7. Next the back 
transmission sensor array 922 is similarly registered through the back position sensor array 934. 
Registration can be to the same transmission array 930 because the front transmission and back 
transmission scans see effectively the same transmission image embedded in the film 902. The 
differences in brightness between the front and back sensors must be corrected if the same array 
930 is used to collect the regression statistics. This correction may be based on equalizing overall 
averages, or may be done as described below. 

It should be noted that if the scans were all made at virtually the same time as described 
before, then the two transmission arrays 922 and 924 will always bear a constant mechanical 
misregistration with each other, in addition to a very small variable misregistration due to film 
warpage away from one lens 912 and toward the other lens 906, which may be minimized by 
selecting telocentric lenses. Thus, once the constant mechanical misregistration is known by 
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performing a mutual registration, it can be applied to the result of registering the front transmission 
sensor array 924 to the transmission film array 930 to obtain a very close estimate of the 
registration of the back transmission sensor array 922 to the same transmission film array 930 
without actually performing the second registration using cross correlations, thereby halving the 
5 needed amount of cross correlations. 

A further embodiment of this method first registers the back transmission sensor array 922 
to the front transmission sensor array 924. Because the two arrays are primarily misregistered by 
a constant mechanical misalignment, it is not necessary to actually calculate the registration with 
cross correlations for each time, but only periodically to check the accuracy of the constant 

10 registration data stored in memory. From the known registration data, the two arrays are 
combined, or added, to compose a single transmission array. This can be done by resizing the back 
transmission sensor array 922 to match in registration the front transmission sensor array 924, and 
then adding the resized data directly to the front transmission sensor array 924. This method 
obviates any overall density differences between the front and back transmission arrays because 

15 only the single sum will subsequently be used to register to and accumulate to the4ransmission 
film array 930. 

Note again that, if the scans were all made at virtually the same time as described before, then 
the two front arrays 920 and 924 are mutually in register and can share the same front position 
sensor array 932, and therefore the front reflection sensor array 920 maps through the shared front 

20 position sensor array 932 to update the front reflection film array 940. Since this front position 
sensor array 932 has been calculated for the front transmission sensor array 924, there is no need 
to do any cross correlation with the front reflection sensor array 920. This is an advantage because 
the transmission image captures all three color layers with better image clarity, and therefore 
allows the more accurate registration based on cross correlation. 

25 Similarly, the two back arrays 922 and 926 are mutually in register, and will share the single 

back position sensor array 934, and therefore the back reflection sensor array 926 maps through 
the shared back position sensor array 934 to update the back reflection film array 942. Thus, all 
four arrays 920, 922, 924, and 926 are registered with only a single prediction step, and only two 
registration steps, where one of the registration steps may be greatly simplified. 

30 While the present invention has been described herein with reference to particular 

embodiments thereof, a latitude of modification, various changes and substitutions are intended 
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in the foregoing disclosure, and it will be appreciated that in some instances some features of the 
invention will be employed without a corresponding use of other features without departing from 
the spirit and scope of the invention as set forth in the claims recited below. 
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CLAIMS: 

1 . A method for obtaining a plurality of registered images that can be used to obtain an image 
during electronic development of a film using a scan station, comprising the steps of: 

scanning a first area of a film containing an image with a scan station during a first time 
during development to generate a first scan; 

moving the film relative to the scan station; and 
scanning a second area of the film at a second time to generate a second scan wherein the second 
area of the film includes at least half of the first area of the film. 

2. The method of claim 1, wherein the scan station comprises an area sensor. 

3 . The method of claim 1 , wherein the scan station comprises a linear sensor and a motive force 
to drive the linear sensor across the film so as to scan the first area on the film during the first time. 

4. The method of claim 1, further comprising the steps of: 
adding the first scan to a film array; and 
registering the second scan to the film array. 

5. The method of claim 4, wherein the registering step comprises estimating a scannable 
appearance of the film at the second time from the contents of the film array. 

6. The method of claim 4, wherein the adding step comprises generating parametric summations 
from the first scan. 

7. The method of claim 4, wherein the first scan is comprised of pixels, and the adding step 
comprises the steps of: 

reading a pointer to a point in the film array for a pixel in the first scan; and 

weighting an addition of a value of that pixel to an element of the film array, the element 

being proximal to the point in proportion to an overlap of that element and a comparable area that 

is centered on the point. 
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8. The method of claim 4, wherein the registering step comprises the steps of: 

estimating a registration of the first scan to the film array to determine an estimate of the 
registration of the first scan; and 

conducting a registration of the second scan within a reduced area around the estimate of the 
registration of the first scan. 

9. The method of claim 8, wherein the conducting step comprises deriving a cross-correlation 
of a region of the first scan and a region of the film array. 

10. The method of claim 4, wherein the registering step comprises the steps of: 
generating a register estimate based on dead reckoning; and 

biasing the second scan toward the register estimate in a region of the film array to which 
earlier scans have not been added. 

1 1 . The method of claim 4, wherein the second scan comprises a second front transmission scan 
and a second back transmission scan, which are each registered to the film array. 

12. The method of claim 1 1 , further comprising the step of adding the second front transmission 
scan and the second back transmission scan to the film array. 

13. The method of claim 4, wherein the second scan comprises a second front transmission scan 
and a second back transmission scan, and the method further comprises the steps of: 

selecting one of the second front transmission scan and the second back transmission scan as 
a first array; 

registering the first array to the film array; 

registering a remaining array of the second front transmission scan and the second back 
transmission scan to the first array; 

combining the remaining array with the first array to form an augmented first array; and 
adding the augmented first array to the film array. 
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1 4. The method of claim 4, wherein the second scan comprises a second front transmission scan 
and a second front reflection scan, and the second front reflection scan is registered in a way 
substantially the same as the second front transmission scan. 

15. A method for obtaining a plurality of registered images that can be used to obtain an image 
during electronic development of a film using a scan station, comprising the steps of: 

generating a plurality of scans by scanning operations; 
moving the film between successive scanning operations; and 
registering the scans to a film array, wherein 

the film array represents a virtual film that characterizes the film, and 
two successive scans include an overlapping portion that corresponds to an overlapping area 
of the film. 

16. The method of claim 15, wherein the overlapping area includes at least half of a first scan of 
two successive scans. 

17. The method of claim 15, wherein the scan station comprises an area sensor. 

1 8. The method of claim 1 5, wherein the scan station comprises a linear sensor and a motive force 
to drive the linear sensor across the film so as to scan the film. 

19. The method of claim 15, wherein the registering step comprises estimating a scannable 
appearance of the film from the contents of the film array. 

20. The method of claim 15, wherein the registering step comprises the steps of: 
estimating a registration of a previous scan to the film array to determine an estimate of the 

registration of the previous scan; and 

conducting a registration of a current scan within a reduced area around the estimate of the 
registration of the previous scan. 
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21. The method of claim 20, wherein the conducting step comprises deriving a cross-correlation 
of a region of the previous scan and a region of the film array. 

22. The method of claim 15, wherein the registering step comprises the steps of: 
generating a register estimate of a current scan based on dead reckoning; and 

biasing the current scan toward the register estimate in a region of the film array to which 
earlier scans have not been added. 

23. The method of claim 15, wherein a current scan comprises a current front transmission scan 
and a current back transmission scan, and the method further comprises the steps of: 

selecting one of the current front transmission scan and the current back transmission scan as 

a first array; 

registering the first array to the film array; 

registering a remaining array of the current front transmission scan and the current back 
transmission scan to the first array; 

combining the remaining array with the first array to form an augmented first array; and 
adding the augmented first array to the film array. 

24. The method of claim 15, wherein a current scan comprises a current front transmission scan 
and a current front reflection scan, and the current front reflection scan is registered in a way 
substantially the same as the current front transmission scan. 

25. A system for obtaining a plurality of registered images that can be used to obtain an image 
during electronic development of a film, comprising: 

a development applicator that applies a developer to a film to be developed; 
an illumination source for illuminating the developing film; 

a sensor for receiving an image from the developing film when it is illuminated by the 
illumination source and producing sensor array data; and 

a computer for processing the sensor array data to obtain registered sensor array data, the 
sensor array data being registered according to a mapping specified by a position array. 
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26. The system of claim 25, wherein the mapping provides a consistent registration for registered 
images taken from overlapping areas of the film. 

27. The system of claim 25, wherein the mapping relates the sensor array data to a virtual film that 
characterizes the film. 



WO 99/43149 



PCT/US99/03846 



1/7 




FIG. 2 



WO 99/43149 



2/7 



PCT7US99/03846 




FILM 



FIG. 3 



WO 99/43149 



3/7 



PCT/US99/03846 



X— 402 
17 18 J 19 20 



418 






23 


Y 


i 


24 , 


414- 






25 




26 



Y 27 


• 

70 


/ 

80 


*100 


* 00 




28 


• 

60 


• 

80 


• 

100 


* 00 


^404 


29 


• 

40 


• 

70 


• 

90 


• 

100 


SENSOR ARRAY 


406— 




\ 18 


19 


20 




27 


37.5, 
23.7 


Wo, 

23.5 


40.6, 
23.3 


42.2, 
23.0 


^408 


28 


37.7, 
25.0 


39.2, 
24.9 


40.9, 
24.5 


42.4, 
24.2 




29 


37.8, 
26.3 


39.4, 
26.2 


41.2, 
25.9 


42.7, 
25.7 


POSITION ARRAY 


37 


38 


39/40 


-412 
41 42 43 


44 



\ 
1 


— — ^ 






•100 


100 




X. 


to: 


80 






• 


100 




•60 


80 




100 








•40 


• 


70 


90 




100 



410 



FILM ARRAY 



FIG. 4 



WO 99/43149 



PCT/US99/03846 




WO 99/43149 



PCT/US99/03846 



5/7 




FIG. 7 



WO 99/43149 



PCT/US99/03846 



6/7 



oooooooooooooooooooooooo 




oc oooooooooooooooooooooooo 




oooooooooooooooooooooooo 



■810 



FIG. 8A 




FIG. 8B 



r 876 872 
' 880 IT 

874 




OOOOOOOX)000 



'o o,o o o o o o 

-862 



OOOOOOOOOOOOOOJOOOOOOO OOP 



854"' 

FIG. 8C 



WO 99/43149 



PCT/US99/03846 



7/7 



> 
o 

I 

33 

m 



CO 

O 



> 
m 



* TO BOTTOM OF FIGURE 

A \f ^912 

JjBACKLAMP x 

910- 7 - 




-902 



aaaaaoriaoaaaBaaaaOi 



£M7/ 



FILM 



X- 
SENSOR 
Y 



FRONT SENSOR 

908 
920 

FRONT REFLECTION SENSOR ARRAY 



/\ / -924 

A 7 FRONTTRANSMISSION SENSOR ARRAY 

/ A -932 



X- 
FILM 




FRONT POSITION SENSOR ARRAY 



FRONT REFLECTION 
FILM ARRAY 



z 



z 



BACK REFLECTION 
FILM ARRAY 



C7CJCJCJCJCJCJCJC2 o □ □ a □ a i 



VIRTUALFILM 
i a a o oooooo^ N 




CO 

o 



> 
m 



x 
> 

33 
O 

m 



BACK POSITION SENSOR ARRAY 



934 y~77 

"y [/ BACK TRANSMISSION SENSOR ARRAY 



926 x , 7 

yl / BACK REFLECTION SENSOR ARRAY 



914- 



t 

, FROM TOP OF FIGURE 



BACK SENSOR 



FIG. 9 



INTERNATIONAL SEARCH REPORT ~ 



Inte anal Application No 

PCT/US 99/03846 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 6 H04N1/00 H04N1/387 



According to international Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Mi mm urn documentation searched (classification system lollowed by classification symbols) 

IPC 6 H04N G06T 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and. where practical search terms used) 



C. OOCUMENTS CONSIDERED TO BE RELEVANT 



Category * 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to daim No. 


X 


EP 0 580 293 A (IBM) 26 January 1994 


15,25 


Y 


see the whole document 


1-4, 






16-18 


A 




11,12, 






14,23,24 


Y 


US 4 777 102 A (LEVINE ALFRED 8) 


1.2,4, 




11 October 1988 


16,17 




see figure 3 




Y 


US 5 568 270 A (ENDO AZUCHI) 


3,18 




22 October 1996 






see column 9, line 38 - line 48; figure 1 




A 


US 5 465 163 A (NIMURA MITSUO ET AL) 


4,8,9, 




7 November 1995 


20,21 




see abstract; claim 1; figures 5,6 





□ 



Further documents are listed in the continuation of box C. 



ID 



Patent family members are listed in annex. 



* Special categories of cited documents : 

"A" document defining the general state of the art which is not 

considered to be of particular relevance 
"E" earlier document but published on or after the international 

filing date 

V document which may throw doubts on priority clatm(s) or 
which ts cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or 
other means 

"P" document published prior to the international filing date but 
later than the priority date claimed 



T" later document published after the international filing date 
or prionty date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

"X" document of particular relevance; the claimed invention 
cannot bo considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"Y" document of particular relevance; the claimed invention 

cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
m (he art. 

document member of ihe same patent family 



Dale of the actual completion of the international search 

10 June 1999 


Date ol mailing ol the international search report 

17/06/1999 


Name and mailing address of the ISA 

European Patent Office. P B. 5818 Patentlaan 2 
NL - 2280 HV Rijswjk 
Tel. (+31-70) 340-2040, Tx. 31 651 epo ni. 
Fax: (+31-70) 340-3016 


Authorized officer 

Hanratty, C 



Form PC 171S A/2 10 (second sftaqlt (July >992) 



RNsnrron <wo 9943149A1 1 > 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 


Intt lonal Application No 

PCT/US 99/03846 


Patent document 
cited in search report 


Publication 
date 


Patent family 
member(s) 


Publication 
date 



EP 0580293 



26-01-1994 



CA 
JP 
JP 
US 
CA 
JP 
JP 
KR 
MX 
US 



A 
A 



2093840 A 
2856637 B 
6133112 
5465155 
2093449 A,C 
2823109 B 
6167757 A 
9705226 B 
9304321 A 
5519510 A 



18-01- 

10- 02- 

13- 05- 
07-11- 
18-01- 

11- 11- 

14- 06- 
14-04- 
31-01- 
21-05- 



1994 
1999 
1994 
1995 
1994 
1998 
1994 
1997 
1994 
1996 



US 4777102 



11-10-1988 



US 
US 
US 
US 
US 
US 
US 
US 
US 
US 



4745040 
4751583 
4588282 
4182568 
4714962 
4716470 
4236813 
4375916 
4438459 
4251153 



17-05- 
14-06- 
13-05- 
08-01- 
22-12- 
29-12- 
02-12- 
08-03- 
20-03- 
17-02- 



1988 
1988 
1986 
1988 
1987 
1988 
1980 
1983 
1986 
1981 



US 


5568270 


A 


22- 


10-1996 


JP 


7015593 A 


17-01-1995 












US 


5684601 A 


04-11-1997 


US 


5465163 


A 


07- 


11-1995 


JP 


4290066 A 


14-10-1992 












JP 


4314263 A 


05-11-1992 












JP 


5030339 A 


05-02-1993 












JP 


5122501 A 


18-05-1993 



rofrn PC17lSA/?l0 (patent family anno it (July 1992) 





FIG. 2 



WO 99/43149 



PCTiXlS99/0384tf 



2/7 




FILM 



WO 99M3I49 



3/7 



r 



X+ 402 
17 18 J 19 20 



Y 27 


*70 


/ 

80 


*100 


*100 




28 


# 60 


80 


*100 


*100 


^-404 


29 


%0 


70 


*90 


*100 


SENSOR ARRAY 


1 ftp 

406*— 




\ 18 


19 


20 




27 


37.5, 
23.7 


^39.0, 
23.5 


40.6, 
23.3 


42.2, 
23.0 


^408 


28 


37.7, 
25.0 


39.2, 
24.9 


40.9, 
24.5 


42.4, 
24.2 




29 


37.8, 
26,3 


39.4, 
26.2 


41.2, 
25.9 


42.7, 
25J 


POSITION ARRAY 



41B 

23 

Y 

+ 24 

414 — ^ 
25 

26 



37 


38 39/40 


■412 

41 42 43 


44 


"** s 

\ 

J 




Ft 




-100 


10*0 








70; 








ft 


100 






•60 


80 




100 










♦ 40 


m 


70 


90 




loo 





410 



FILM ARRAY 



FIG. 4 



WO 



PCIYUS99fflM4ti 




W0 99M3U9 PCT/US95M»8<6 

5/7 



TRANSMISSION 
SENSOR ARRAY 




FIG. 7 



BNSDOCID <WO 9943149A1TI,> 



WO 99/43149 



PCT7US99/03*W6 



6/7 



oooooooooooooooooooooooo 




oc oooooooooooooooooooooooo 




oooooooooooooooooooooooo 



FIG. 8A 




FIG. 8B 



■810 



' l 674 




OOOOOOONDOO 



foaoooooo 



& '-852 



OOOOOOOOOOOOOOpOOOOOOOOO 



854-' 

FIG. 8C 



PCT/US9?.U3$4<S 



7 /7 



TO BOTIKSI OF FIGURE 
Jgj BACK LAMP fa/ 

/ — Z3Ty FILM 



902 



-o|<3— 



FRjCWT SENSOR 



o 



SENSOR 



,--920 

^ FRONT REFIECTION SENSORARRAY 



m 



/{ /-a* 

/| 7 FRONT TRANSMISSION SENSORARRAY 



S32 

FMNTKBIlJONSBISCRflW 



FILM 



4 



T 



^1 



/I 7 FRONT REFLECTION 

/ / FILM' 

FILM, 



7^ 



Z-V "WP" 




I 



O 



m 



-o|<5— 





BACK POSffTION SEMSOR ARRAY 
BACK TRANSMISSION SENSORARRAY 



> 



BMXR£FLECTO)N SENSORAfiRAY 



BACK SENSOR 



FROM TOP OF FIGURE 



FH 



